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Cross-references to Related Application 

This application is related to the following applications: 



L United States Patent Application entitled, "Method and Apparatus for Providing an 
Error Characterization Estimate of an Impulse Response Derived using Least 
Squares", filed on the same date as the instant application by Awad T. et al 



2. United States Patent Application entitled, "Method and Apparatus for Generating a 
Set of Filter Coefficients Providing Adaptive Noise Reduction", filed on the same 
date as the instant application by Awad T. et al. 



3. United States Patent Application entitled, " Method and Apparatus for Generating a 
Set of Filter Coefficients", filed on the same date as the instant application by Awad 



The contents of the above noted documents are hereby incorporated by reference. 
Field of the Invention 

The present invention relates generally to time updated adaptive system and, more 
particularly, to a method and apparatus for generating time updated filter coefficients for 
use in a time updated adaptive filter as can be used in echo cancellation devices, 
equalizers and in general systems requiring time updated adaptive filtering. 

Background 

Various adaptive filter structures have been developed for use in time updated 
adaptive systems to solve acoustical echo cancellation, channel equalization and other 
problems; examples of such structures include for example, transversal, multistage 
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lattice, systolic array, and recursive implementations. Among these, transversal finite- 
impulse-response (FIR) filters are often used, due to stability considerations, and to their 
versatility and ease of implementation. Many algorithms have also been developed to 
adapt these filters, including the least-mean-square (LMS), recursive least-squares, 
5 sequential regression, and least-squares lattice algorithms. The LMS algorithm is the 
most commonly used algorithm. It requires neither matrix inversion nor the calculation of 
correlation matrices, and therefore is often selected to perform the adaptation of the filter 
coefficients, 

10 A deficiency of the LMS algorithm is that it requires the selection of a "seed" 

factor value (pi), also referred to as the step size or gain. The "seed" factor value ([i) 
permits the adaptation of the filter coefficients using the LMS method and also allows the 
filter coefficients to converge. The seed factor value (|x), which may be constant or 
variable, plays an important role in the performance of the adaptive system. For 

15 example, improper selection of the "seed" factor value (ji) may cause the adaptive filter 
to diverge thereby becoming unstable. For more details regarding the convergence 
properties, the reader is invited to refer to B. Widrow and Steams, S.D,, Adaptive Signal 
Processing, Prentice-Hall, Englewood Cliffs, NJ, 1985, The content of this document is 
hereby incorporated by reference. A proper selection of the seed factor value (|Li) requires 

20 knowledge of the characteristics of the signals that will be processed by the time updated 
adaptive filter. Consequently, a same "seed" factor value ((x) may be suitable in an 
adaptive filter in a first system and unsuitable in an adaptive filter in a second system due 
to the characteristics of the signals being processed, 

25 Consequently, there is a need in the industry for providing a novel method and 

apparatus for adapting time updated filter that alleviates, at least in part, the deficiencies 
associated with existing method and apparatuses. 

Summary of the Invention 

30 

In accordance with a broad aspect, the invention provides a method for producing 
a set of filter coefficients. The method includes receiving a sequence of samples of a first 
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signal and a sequence of samples of a second signal, where the second signal includes a 
component that is correlated to the first signal. The method also includes receiving a 
scheduling signal including a succession of scheduling commands, the scheduling 
command indicating that a new set of filter coefficients is to be computed. The 
5 scheduling signal is such that a new scheduling command is issued when at least two 
samples of the first signal are received subsequent to a previously issued scheduling 
command. In response to a scheduling command, a set of filter coefficients is generated 
at least in part on the basis of the first and second signals. The set of filter coefficients is 
such that when the set of filter coefficients is applied by a filter on the first signal, an 
10 estimate of the component correlated to the first signal is generated. An output signal 
indicative of the set of filter coefficients is then released. 

Advantageously, the use of a scheduling signal including a succession of 
scheduling commands allows a better utilization of computing resources for the 

15 computations of filter coefficients. The intervals between the scheduling commands in 
the scheduling signals depend on the time varying characteristics of the system in which 
the method for generating time updated filter is being used and are determined on the 
basis of heuristic measurements. In other words, by providing a scheduling signal 
including a succession of scheduling commands and by selecting the intervals between 

20 the scheduling commands based on heuristic performance measurements, the 
computational costs of computing a set of filter coefficient for each sample can be 
avoided without significantly deteriorating the apparent adaptation quality of the adaptive 
filter. 

25 Li a non-limiting example, the method for producing a set of filter coefficients is 

implemented in an adaptive filter of an echo canceller for cancehng echo in a return path 
of a communication channel For example, for an echo canceling device, the filter 
coefficients may only need to be recomputed every second (i.e. once every second) 
without noticeably affecting the performance of the echo canceller. Therefore, assuming 

30 that 8000 samples of the fn-st and second signals are received every second (sampling rate 
of 8000Hz), a new set of filter coefficients would be computed every 8000 samples, 
according to the above time period, and so scheduling commands would be sent 
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accordingly. It is to be readily appreciated that scheduling commands in the scheduling 
signal need not be sent at regular intervals and may have tune varying characteristics 
without detracting from the spirit of the invention, hi another specific example of 
implementation, the scheduling commands are asynchronous and are issued on the basis 
5 heuristic measurements of the time varying characteristics of the input signals. 

In a specific example of implementation, a least squares algorithm is apphed on 
the first and second signals to derive the set of filter coefficients. 

10 For each received sample of the first signal, the sequence of samples of the first 

signal is processed to generate a first set of data elements, v/here the first set of data 
elements is a compressed version of a second set of data elements. 

Continuing the specific implementation, for each received samples of the first and 
15 the second signals, the sequences of samples of the first and second signal are processed 
to generate a third set of data elements. In a non-limiting example, the third set of data 
elements is indicative of a set of cross-correlation data elements for the sequence of 
samples of the first signal and the sequence of samples of the second signal. 

20 Continuing the specific implementation, in response to a scheduling command, 

the first set of data elements is processed to generate the second set of data elements. In a 
non-limiting example, the second set of data elements is indicative of a set of auto- 
correlation data elements for the sequence of samples of the first signal, the set of auto- 
correlation data elements being a representation of a two-dimensional matrix data 

25 structure. The first set of data elements includes a sub-set of the set of auto-correlation 
data elements, the sub-set of auto-correlation data elements corresponding to a row of the 
two-dimensional matrix data structure. More specifically, the two-dimensional matrix 
data structure is of dimension NxN, and the first set of data elements includes a sub-set of 
N auto-correlation data elements corresponding to a row of the two-dimensional matrix 

30 data structure. The first set of data elements also includes a first sample set including the 
first N-1 received samples of the first signal and a second sample set including the last N- 
1 received samples of the first signal. In response to a scheduling command, the two- 
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dimensional matrix data structure is generated on the basis of the first sample set, the 
second sample set and the sub-set of N auto-correlation data elements. 

In other words, for each received sample of the first signal, the sub-set of N auto- 
5 correlation data elements, elements of the second sample set and, if applicable, elements 
of the first sample set are updated. The generation of the two-dimensional NxN auto- 
correlation matrix data structure is delayed until receipt of a scheduling command. 

Advantageously, the above allows maintaining the context of the two-dimensional 
10 NxN auto-correlation matrix data structure by maintaining a compressed version thereof, 
namely the sub-set of N auto-correlation data elements, the first sample set and the 
second sample set. 

Continuing the specific implementation, the second set of data elements and the 
15 third set of data elements are then processed to generate the set of filter coefficients. In a 
non-limiting example, for each new received sample of the first signal and sample of the 
second signal, a set of previously received samples of the first signal and the new sample 
of the first signal are processed to update the first set of data elements. The set of 
previously received samples of the first signal (including the new sample) and the new 
20 sample of the second signal are processed to update the set of cross-correlation data 
elements. In response to a scheduling command, the first set of data elements is 
processed to generate the second set of data elements being a representation of the auto- 
correlation matrix data structure. The auto-correlation matrix data structure and the 
cross-correlation data elements are then processed to derive a set of filter coefficients. 

25 

Advantageously, this method allows maintaining the context of the system by 
maintaining the first signal's auto-correlation data elements and the cross-correlation of 
the first signal with the second signal. The generation of a new set of filter coefficients is 
delayed until a scheduling command is received. 

30 

In a non-limiting example, a Cholesky decomposition method is applied to the 
auto-correlation matrix data structure to derive a lower triangular matrix data structure 
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and an upper triangular matrix data structure. The lower triangular matrix data structure 
and the upper triangular matrix data structure are then processed on the basis of the cross- 
correlation data elements to derive the set of filter coefficients. 

5 In accordance with another broad aspect, the invention provides an apparatus for 

implementing the above-described method. 

In accordance with yet another broad aspect, the invention provides a computer 
readable medium including a program element suitable for execution by a computing 
10 apparatus for producing a set of filter coefficients in accordance with the above described 
method. 

In accordance with yet another broad aspect, the invention provides an adaptive 
filter including a first input for receiving a sequence of samples fi:om a first signal and a 

15 second input for receiving a sequence of samples of a second signal The second signal 
includes a component that is correlated to the first signal. The adaptive filter also 
includes a filter adaptation unit including a scheduling controller, a processing unit and 
an output. The scheduling controller is operative for generating a scheduling signal 
including a succession of scheduling commands, a scheduling command indicating that a 

20 new set of filter coefficients is to be computed. The scheduling signal is such that a new 
scheduling command is issued when at least two samples of the first signal are received 
subsequent to a previously issued scheduling command. The processing unit is 
responsive to a scheduling command from the scheduling controller to generate a set of 
filter coefficients at least in part on the basis of the first and second signals. The output 

25 releases an output signal indicative of the set of filter coefficients generated by the 
processing unit. The adaptive filter also includes a filter operatively coupled to the first 
input and to the output of the filter adaptation unit. The filter is operative to apply a 
filtering operation to the first signal on the basis of the set of filter coefficients received 
fi*om the filter adaptation unit to generate an estimate of the component in the second 

30 signal correlated to the first signal 
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In accordance with another broad aspect, the invention provides an echo cancellor 
comprising an adaptive filter of the type described above. 

Other aspects and features of the present invention will become apparent to those 
5 ordinarily skilled in the art upon review of the following description of specific 
embodiments of the invention in conjunction with the accompanying figures. 

Brief Description of the Drawings 

10 

Fig. 1 is a block diagram of a time adaptive system including a filter adaptation unit in 
accordance with an embodiment of the present invention; 

Fig. 2 is a block diagram of the filter adaptation unit of figure 1 including a scheduling 
15 controller unit 204, a context update module 200 and a filter coefficient computation unit 
202 in accordance with a specific example of implementation of the invention; 

Fig. 3 is functional block diagrams of the context update module 200 of the filter 
adaptation unit in accordance with a specific non-limiting example of implementation of 
20 the invention; 

Fig. 4 is a functional block diagram of filter coefficient computation unit 202 of the filter 
adaptation unit shown in figure 2 in accordance with a specific non-limiting example of 
implementation of the invention; 

25 

Fig. 5 is a block diagram of a data structure including the first set of data elements in 
accordance with a non-limiting example of implementation of the invention; 



30 



Fig. 6 is a block diagram of a data structure including the third set of data elements in 
accordance with a non-limiting example of implementation of the invention; 
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Fig. 7 shows an auto-correlation matrix data structure in accordance with a non-limiting 
example of implementation of the invention; 

Fig. 8 is a flow diagram of a process for generating a set of filter coefficients in 
5 accordance with an example of implementation of the invention; and 

Fig, 9 is a block diagram of an apparatus for generating a set of filter coefficients in 
accordance with a specific example of implementation of the invention. 

10 Detailed Description 

Figure 1 shows a time adaptive system 170 in accordance with an embodiment of 
the present invention. In one example of a non-limiting implementation, the time 
adaptive system 170 is used to remove unwanted components of a return signal Z 102 
fi-om a forward signal Y 106. Typically, the return signal Z 102 passes through a system 
150 and emerges in the form of a noise signal E 1 14 which corrupts the forward signal Y 
106, resulting in a corrupted forward signal X 104. In a digital system, this corruption 
process may be modelled as a sample-by-sample addition performed by a conceptual 
adder 118. Thus, each sample of the corrupted forward signal X 104 is the sum of a 
component due to the (clean) forward signal Y 106 and another component due to the 
noise signal E 1 14 where the noise signal E 1 14 is correlated to the return signal Z 102. 

A non-limiting use of the time adaptive system 170 is in the context of acoustical 
25 echo cancellation, for example, in a hands-free telephony system that includes a 
loudspeaker and a microphone. In this case, the forward signal Y 106 is a locally 
produced speech signal which is injected into the microphone (represented by conceptual 
adder 118), the return signal Z 102 is a remotely produced speech signal which is output 
by the loudspeaker, the system 150 is a room or car interior and the noise signal E 1 14 is 
30 a reverberated version of the return signal Z 102 which enters the same microphone used 
to pick up the forward signal Y 106. The corrupted forward signal X 104 is the sum of 
the signals input to the microphone, including the clean forward signal Y 106 as well as 
the reverberation represented by the noise signal E 1 14. 
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Another non-limiting use of the time adaptive system 170 is in the context of 
electric echo cancellation, for example, where the echo is caused by an analog/digital 
conversion on the transmission channel rather than by a signal reverberation in a closed 
5 space. In this case, the forward signal Y 106 is a locally produced speech signal which 
travels on the forward path of the communication channel, the return signal Z 102 is a 
remotely produced speech signal which travels on the return path of the communication 
channel, the system 150 is an analog/digital conversion unit and the noise signal E 114 is 
a reflected version of the return signal Z 102 which travels on the same forward path of 
10 the communication channel as the forward signal Y 106, The corrupted forward signal X 
104 is the sum of the clean forward signal Y 106 as well as the noise signal E 1 14. 

To cancel the corruptive effect of the noise signal E 1 14 on the forward signal Y 
106, there is provided a filter 110, suitably embodied as an adaptive digital filter. The 
15 filter 110 taps the return signal Z 102 (which feeds the system 1 50) and applies a filtering 
operation thereto. In one embodiment of the present invention, such a filtering operation 
can be performed by a fijiite impulse response (FIR) filter that produces a filtered signal 
F112. 

20 The filter 110 includes a plurality N of taps at which delayed versions of the 

return signal Z 102 are multiplied by respective filter coefficients, whose values are 
denoted by hj, 0<j< N-L The AT products are added together to produce the filter output 
at time T. Simply stated, therefore, the filtered signal F 1 12 at a given instant in time is a 
weighted sum of the samples of the return signal Z 102 at various past instances. 

25 

The filter coefficients hj are computed by a filter adaptation unit 100 configured to 
receive the return signal Z 102 and the corrupted forward signal X 104. The manner in 
which the filter adaptation unit 100 processes these signals to compute the filter 
coefficients hj is described in greater detail herein below. 

30 



Mathematically, the filtered signal F 112 at the output of the filter 110 can be 
described by the following relationship: 
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Equation 1 

where 

t is the current sample time; 

ft is the value of the filtered signal F 1 12 at time t\ 

hj is the value of the 7* filter coefficient; 

Zk is a sample of the return signal Z 102 at time k; and 

A'' is the length (i.e., the number of taps) of the filter 110. 

For convenience, equation 1 may be represented in matrix form as follows: 

Equation 2 

f.=ffz, 

where the underscore indicates a vector or matrix, where the superscript denotes the 
transpose (not to be confused with the sample time used as a subscript) and where: 

Equation 3 























and z, = 













The output of the filter 110, namely the filtered signal F 112, is subtracted on a sample- 
by-sample basis from the corrupted forward signal X 104 to yield an estimate, denoted 
Y* 108, of the clean forward signal Y 106, In a desirable situation, the filter coefficients 
hj will be selected so as to cause the resultant signal Y* 108 to be "closer" to the clean 
forward signal Y 106 than corrupted forward signal X 104. For at least one optimal 
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combination of filter coefficients, the resultant signal Y* 108 will be at its "closest" to the 
clean forward signal Y 106. 

In many cases, it is convenient to define "closeness" in terms of a least-squares 
5 problem. In particular, the optimal filter coefficients are obtained by solving an 
optimisation problem whose object it is to minimise, from among all possible 
combinations of filter coefficients hp the mean square difference between instantaneous 
values of the resultant signal Y* 108 and the clean forward signal Y 106. The actual 
value of the minimum mean-square error is typically not as important as the value of the 
10 optimal filter coefficients that allow such minimum to be reached. 

A reasonable assumption is that noise signal E 1 14 adds energy to forward signal 
Y 106. Therefore an expression of the least square problem is to minimise the resultant 
signal Y* 108. Mathematically, the problem in question can be defined as follows: 

15 

Equation 4 

TmxE[{yy\, 

h 

where E[o\ denotes the expectation of the quantity "o" over a subset of time up until the 
20 current sample time /. For the purpose of this specific example, the expression E[o]^ , 
will denote the summation of the quantity "o" over a subset of time up until the current 
sample time t. Another commonly used notation is ^ [o\ . Therefore, for the purpose of 

this example the expressions E[o\ and ^ [o\ are used interchangeably. 
25 Now, from Figure 1 it is noted that: 



Equation 5 
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and 

Equation 6 

5 Therefore, the problem stated in Equation 4 becomes: 

Equation 7 

min£[(x,-^^zj'],, 

h 

10 

Expanding the term in square brackets, one obtains: 

Equation 8 

15 

Taking the expected value of both side of equation 8, one obtains: 

Equation 9 

20 

Minimizing the above quantity leads to a solution for which the resultant signal Y* 108 
will be at its minimum and likely at its "closest" to the clean forward signal Y 106. To 
minimize this quantity, one takes the derivative of the right-hand side of Equation 9 with 
respect to the filter coefficient vector h and sets the result to zero, which yields the 
25 following: 

Equation 10 

~(E[xll 'E[lx£z,\ ^E[h'z,zlhl ) = -2E[x,z,l^2E[z,zlhl = 0. 
ah 

Thus, an "optimal" set of filter coefficients h*j solves the set of equations defined by: 
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Equation 11 

It is noted that equation 1 1 expresses the filter coefficient optimisation problem in 
5 the form Ah = B, where A^E[z,zll and B = E[x,z,l and that the matrix A is 
symmetric and positive definite for a non-trivial signal Z 102. The usefulness of these 
facts will become apparent to a person of ordinary skill in the art upon consideration of 
later portions of this specification. 

10 It is further noted that since the properties of the signals Z 102 and X 104 change 

with time, so too does the optimal combination of filter coefficients h*j, 0<j < N-1, 
which solves the above problem in Equation 11. The rate at which the filter coefficients 
are re-computed by the filter adaptation unit 100 and the manner in which the 
computations are effected are now described in greater detail with reference to Figure 2, 

1 5 which depicts the filter adaptation unit 1 00 in greater detail. 

The filter adaptation unit 100 includes a first input 252 for receiving a sequence of 
samples of a first signal Z 102, a second input 254 for receiving a sequence of samples of 
a second signal X 104, a scheduling controller 204, a processing unit 250 and an output 
20 256 for releasing an output signal indicative of a set of filter coefficients 1 1 6. 

The scheduling controller 204 is operative for generating a scheduling signal 
including a succession of scheduling commands. A scheduling command indicates that a 
new set of filter coefficients is to be computed by the processing unit 250. The scheduling 
25 signal is such that a new scheduling command is issued when a group of at least two 
samples of the first signal Z 102 are received subsequent to a previously issued 
scheduling command. 

In other words, the scheduling command indicates that one set of filter 
30 coefficients is generated for the group of at least two samples. 
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The intervals between the scheduling commands in the scheduling signal depend 
on the time varying characteristics of time adaptive system 150. In a non-limiting 
implementation, the intervals between the scheduling commands are determined on the 
basis of heuristic measurements. For example, if the time adaptive system 150 is an echo 
5 canceller for canceling echo in a return path of a communication channel, the set of filter 
coefficients may only need to be recomputed every second in order for the filter 110 to 
adequately track the time varying characteristics of the time adaptive system 150. 
Therefore, assuming that 8000 samples of the first and second signals are received every 
second (sampling rate of 8000Hz), a new set of filter coefficients would be computed 

10 every 8000 samples and so a scheduling command would be generated by the scheduling 
controller every second (8000 samples). It is to be readily appreciated that scheduling 
commands in the scheduling signal need not be sent at regular intervals and may have 
time varying characteristics without detracting from the spirit of the invention. In another 
specific example of implementation, the scheduling commands is asynchronous and is 

15 issued on the basis heuristic measurements of the time varying characteristics of the input 
signals X 104 and Z 102, 

The processing imit 250 receives the first signal Z 102 and the second signal X 
104 from the first input 252 and the second input 254 respectively. The processing unit 

20 250 is responsive to a scheduling command from the scheduling controller 204 to 
generate a set of filter coefficients at least in part on the basis of the first signal Z 102 and 
the second signal 104. In a non-limiting example, the processing imit 250 applies a least 
squares method on the first and second signals to derive the set of filter coefficients 116. 
The processing unit 250 generates a set of coefficients hj, 0< j < N-l by solving equation 

25 1 1 reproduced below: 

Equation 11 



30 The processing unit 250 depicted in figure 2 includes a context update module 200 and a 
filter coefficient computation unit 202. 
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The context update module 200 receives the sequence of samples of the first 
signal Z 102 and the sequence of samples of the second signal X 104. The context update 
module 200 generates and maintains contextual information of the first signal Z 102 and 
the second signal X 104. The context update module maintains sufficient information 

5 about signals Z 102 and X 104 to be able to derive E[zj^zl\ and E[Xj^Zj^\ for the current 

time t. For each new received sample of signals Z 102 and X 104, the contextual 
information is updated. This contextual information is then used by the filter coefficient 
computation unit 202 to generate the set of filter coefficients 1 16. 

10 ha a specific implementation, the contextual information comprises a first set of 

data elements and a third set of data elements. The first set of data elements is a 
compressed version of a second set of data elements, where the second set of data 

elements is indicative of the auto-correlation of signal Z 102 E[Zf^zl\ . Li a non-limiting 

example, the first set of data elements includes a set of N auto-correlation data elements 
15 of the first signal Z 102 as well as sets of samples of signal Z 102, The third set of data 

elements is a set of cross-correlation data elements ElXj^Zf^]^ of the first signal Z 102 with 

the second signal X 104. 

The filter coefficient computation unit 202, in response to a scheduling conmiand 
20 fi-om the scheduling controller 204, makes use of the contextual information provided by 
the context update module to generate a set of filter coefficients 116. The filter 
coefficient computation unit 202 delays the computation of a new set of filter coefficients 
until the receipt of a scheduling command, hi response to a scheduling conmiand, the 
filter coefficient computation unit 202 processes the first set of data elements and 

25 expands it to derive the second set of data elements to obtain E[zj^zl\ , The second set 
of data elements and the third set of data elements are then processed to generate a set of 
filter coefficients by applying a least squares method. The set of filter coefficients is such 
that when the set of filter coefficients are applied by filter 1 10 on the first signal Z 102, a 
filtered signal F 112 which is an estimate of the component correlated to the signal Z 102 

30 in the second signal X 104, namely signal E 114, is generated. The filter coefficient 
computation imit 202 solves equation 1 1 reproduced below: 
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Equation 11 

5 In a non-limiting example, the second set of data element can be represented by 

an NxN symmetric matrix "A" describing the expected auto-correlation of signal Z 102, 

E[zj^zl\ . Matrix "A" is symmetric and positive definite. The third set of data elements, 
indicative of the expected cross-correlation between signal Z 102 and signal X 104, can 
be represented by a vector "B" of M elements, E[Xj^z^\, Finally the set of filter 

10 coefficients can be represented by a third vector The relationship between "A", "B" 
and A* can be expressed by the following linear equation: 

Equation 12 

15 

If M = N, a single vector A * can be computed from the above equation. If M > N, 
then a vector can be computed for each N elements of vector "B". There are many 
known methods that can be used to solve a linear equation of the type described in 
equation 12 and consequently these will not be described further here. 

20 

The generated set of filter coefficients hp 0< j < N-1 116 is then released at the 
output 256 for use by the adaptive filter 110. 

The context update module 

25 

Figure 3 depicts the context update module 200 in greater detail. The context 
update module 200 includes an auto-correlation computing unit 300 and a cross- 
correlation computing xmit 304. 

30 The auto-correlation computing unit 300 generates a first set of data elements 

indicative of a compressed version of a second set of data elements. The second set of 
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data elements is indicative of an auto-correlation data structure for the sequence of 

samples of the first signal Z 102 and is indicative of E[zj^zl\ . In a specific example, the 

second set of data elements can be represented by an NxN auto-correlation matrix (A) 
700 of the type shown in figure 7 including entries. The NxN auto-correlation matrix 
5 (A) 700 is synmietric meaning that: 

A = A'^ 

The matrix A is also positive definite meaning that the inverse of matrix A exists. 

10 Since matrix A is an auto-correlation matrix it will be positive definite when signal Z 102 
is non-trivial. The first set of data elements includes a sub-set of N auto-correlation data 
elements selected from the N entries in the NxN auto-correlation matrix 700. Li a non- 
limiting example, the sub-set of N auto-correlation data elements is indicative of the first 
row of the NxN auto-correlation matrix 700. As the auto-correlation matrix 700 is a 

15 symmetric matrix, it will readily appreciated that the set of N auto-correlation data 
elements may also be indicative of the first colimrn of the NxN auto-correlation matrix 
700. It will become apparent to a person of ordinary skill in the art upon consideration of 
later portions of this specification that, although the specific example described in this 
specification includes a sub-set of N auto-correlation data elements indicative of the first 

20 row of the NxN auto-correlation matrix 700, the sub-set of N auto-correlation data 
elements can be indicative of any one row (or column) of the NxN auto-correlation 
matrix 700 without detracting from the spirit of the invention. 

For each received sample of the first signal Z 102, the auto-correlation computing 
25 unit computes the following: 

Equation 13 

t-N 

1^0 
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where is a sample of Z at time k, t is the current sample time and N is the 
window size for the auto-correlation. In the mathematical expression shown in equation 

2, E[Zf^zl\^^^(^ denotes a computation of a sub-set of the expected value of the auto- 
correlation of the first signal Z since time 0 until the current sample at time t. 
5 ^'[ijt^Il^rowo i^ ^^^^^ auto-correlation matrix 700 and includes a set of 

N auto-correlation data elements. For the purpose of simplicity, we will refer the set of N 
auto-correlation data elements as vector ZZ. 

The first set of data elements also includes sets of samples of signal Z 102. The 
10 sets of samples in combination with the sub-set of N auto-correlation data elements allow 
the second set of data elements indicative NxN auto-correlation matrix 700 to be derived. 
The derivation of the second set of data elements on the basis of the first set of data 
elements will be described later on in the specification. The first set of data elements is 
stored in an auto-correlation memory unit 302. 

15 

Figure 5 shows in greater detail the auto-correlation memory unit 302 storing the 
first set of data elements. As depicted, the first set of data elements includes a first 
sample set 500 including the first N-1 received samples of the first signal Z 102, a sub-set 
of N auto-correlation data elements 502 (vector ZZ) and a second sample set 504 
20 including the last N-1 received samples of the first signal. In a non-limiting example, 
each of the first set 500 of data elements, the sub-set of N auto-correlation data elements 
(vector ZZ) 502 and the second set of data elements 504 is stored in a vector data 
structure. For each received sample of signal Z 102, the content of the auto-correlation 
memory unit 302 is updated as follows: 

25 



30 
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Equation 14 (SAMPLE_SET_#1) 
whent<=N-l 

SAMPLE_SET_#l[i] = SAMPLE_SET_#10+1] j== 0 N-3 
SAMPLE_SET_#l[N-2] = z^i 

5 

whent>N-l 
No change 

Equation 15 (SAMPLE_SET_#2) 
for all t 

10 SAMPLE__SET_#2[j] = SAMPLE_SET_#20+1] for j= 0 ... N-3 

SAMPLE_SET_#2[N-2] = Zm 

Equation 16 VECTOR ZZ 
fort>N'l 

15 ZZ[7] = ZZL/'L + h-N^t-N.j forr 0 N-1 

where SAMPLE_SET_#1 is a vector including the N-1 first samples of signal Z 102 and 
SAMPLE_SET_#2 is a vector including the N-1 last samples of signal Z 102. On the 
basis of the above, the computational cost of updating the vector ZZ 502 is N multiply- 
20 and-add operations per sample: i.e. cost is N. 

The cross-correlation computing unit 304 computes a third set of data elements 
indicative of a set of cross-correlation data elements between the signals Z 102 and X 104 
indicative of E[x^z^\ . For each received sample of the first signal Z 102 and the second 
25 signal X 104, the cross-correlation computing unit computes the following for t > M: 

Equation 17 

r-l 

E[Xj^z^\ ^Ya^i^j-M^\^i for j= 0 ... M-1 

/=0 
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Where Xt_i is a new sample of the signal X 104 at time T, Zt-i is a new sample of 
signal Z 102 at time t and M is the window size for the cross-correlation, hi the 
mathematical expression shown in equation 17, ElXj^Zj^]^ denotes a computation of the 
expected value of the cross-correlation between the first signal Z 102 and the second 
5 signal X 104 since time 0 (no sample) until the current sample at time T. ^[x^z^], is a 

set of M cross-correlation data elements. The M cross-correlation data elements are 
stored in a data structure in a cross-correlation memory unit 306. Figure 6 shows the 
correlation memory unit 306 storing a data structure in the form of a vector of M 
elements including the M cross-correlation data elements. For the purpose of simplicity, 
10 we will refer the set of M cross-correlation data elements as vector XZ. For each 
received sample of signal X and each received sample of signal Z, the content of vector 
XZ in the cross-correlation memory unit 606 is updated as follows, again for t > M: 

Equation 18 

15 XZ [;•] = XZ + for j= 0 . . . M-1 

On the basis of the above, the computational cost of updating vector XZ is M multiply- 
and-add operations per sample, i.e. cost is M. 

20 In a non-limiting embodiment, the context update module 200 includes buffer 

modules for accumulating samples of signal Z 102 and signal X 104. Li this alternative, a 
plurality of samples of signal Z 102 and a plurality of samples of signal X 104 are 
accumulated in the buffers and the above described computations are effected for each 
sample of signal Z 102 and signal X 104 in the buffers. 

25 

Alternatively, when the context update module 200 includes buffer modules, the 
auto-correlation data elements in vector ZZ and the cross-correlation data elements in 
vector XZ may be computed in the frequency domain using FFT (Fast Fourier transform) 
techniques. 

30 
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The process of computing a cross-correlation in the spectral domain between 
signal Z 102 and signal X 104 will be readily apparent to the person skilled on the art and 
therefore will not be described further here. The set of cross-correlation data elements 
resulting from this computation are in the frequency or spectral domain. To obtain the 
5 temporal values of the set of cross-correlation data elements, an inverse Fourier transform 
(IFF) must be applied to the spectral values. 

With regard to the auto-correlation computation, an FFT of length 2N is first 
performed on N samples of signal Z 102, where the N samples have been accumulated in 

10 a buffer. The computation of an FFT is well-known in the art to which this invention 
pertains and as such will not be described further here. The FFT produces 2N complex 
values in a vector, which will be referred to as Zft. If signal Z 102 is a real signal, values 1 
to N-1 of Zft will be the complex conjugates of values 2N-1 to N+1 (respectively, so 1 is 
conjugate of 2N-1, 2 is conjugate of 2N-2, etc.) and values 0 and N are real-only. Zft is 

15 the Fourier transform of the last N samples of signal Z 102 and can be represented as 
follows: 



In order to compute the auto-correlation data elements, we make use of an 
overlap-add technique. Each element in Z^ is first multiplied with itself to obtain vector 
ZZfot. Mathematically, the computation of ZZfotcan be represented as follows: 



Equation 19 





ft-2N+l 



20 



25 



Equation 20 



ZZ 




ft 
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Zft is then multiplied with the FFT computed for the set of N samples preceding 
the current set of N samples of signal Z 102, referred to as Zft-N- This multiplication 
yields the auto-correlation of the current N samples of signal Z 102 with the previous N 
samples of signal Z 102, which we shall call Znt. Mathematically, the computation of 
5 ZZfit can be represented as follows: 



Equation 21 

10 Between the two computations presented in equations 20 and 21, each sample of 

signal Z 102 between Zt and Zt-(N-i) has been correlated with each sample of signal Z 102 
between Zt and Zt-(N-i). Following this, ZZfot and ZZnt are added spectrally to the auto- 
correlation of the previous set of N samples of signal Z, namely ZZot-N and ZZu-n, to 
yield ZZot and ZZu sums. Mathematically, this can be expressed as follows: 

15 Equation 22 

ZZ^^ = ZZ^j^^ + Zyi^ 

Where ZZot and ZZu are indicative of the last row of the NxN auto-correlation 
matrix in the spectral (FFT) domain. To reconstruct the last row of the NxN matrix in the 
20 time domain, an IFFT (inverse Fast-Fourier Transform) is performed on each of these 
vectors to obtain the N samples of the ZZ vector. In this example, vector ZZ is indicative 
of a set of N data elements indicative of the last row of the NxN auto-correlation matrix 
in the temporal domain. This only needs to be performed once before each time the NxN 
matrix is constructed. 

25 

hi terms of computational costs, since a correlation in the time-domain becomes a 
multiplication in the frequency domain, significant cost savings in terms of computational 
requirements can be obtained using FFT techniques when N and M are large. 
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If signals Z 102 and X 104 are real 

The cost of computing an FFT of length 2N on N samples on either signal 
is log2(2N)*2N. Therefore, the total cost of the FFT for signals Z 102 and X 104 
is 4N*log2(2N). The computational cost of an IFFT is the same as the cost for an 
FFT, namely log2(2N)*2N for a real signal Therefore, the total cost of the IFFT 
for signals Z 102 and X 104 is 4N*log2(2N). 

For the cross-correlation: 

The computational cost of computing the cross-correlation between signal 
Z and signal X in the spectral domain is 2N complex multiplications, or 8N 
multiplications, 

For the auto-correlation: 

The computational cost of computing Zfot is 2 for each element of Zft^ 
because the elements of Zft are complex numbers. Therefore, the computational 
cost of computing Zfot is 2N multiply-and-add operations if signal Z 102 is real. 
The computational cost of computing Znt is N-1 complex multiplications and 2 
real multiplications, or 4N-2 multiplications if signal Z 102 is a real signal. The 
computational cost of spectrally adding ZZfot and ZZm to ZZot-N and ZZu-n is 4N 
additions. 

Therefore, the total cost of maintaining the context of the auto-correlation 
of signal Z and the cross-correlation between X and Z is: 

Equation 23 

4N*log2(2N) + 2N + 4N + 4N- 2 + 8N 

4N*log2(2N) + 18*N-2 
Consequently, the cost per sample is (for large N): 
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4*log2(2N) + 18 

For a sample rate of SR samples per second, the number of computations 
required to maintain the context of the auto-correlation of signal Z and the cross- 
correlation between X and Z is: 

4*SR*log2(2N) + 18*SR 

Since the EFFT is not included at every iteration but only when the filter 
coefficients are to be computed, these computations are not included here. 

If signals Z 102 and X 104 are complex 

The cost of computing an FFT of length 2N on N samples on either signal 
is log2(2N)*4N. Therefore, the total cost of the FFT for signals Z 102 and X 104 
is 8N*log2(2N). The computational cost of an IFFT is the same as the cost for an 
FFT, namely log2(2N)*4N for a complex signal. Therefore, the total cost of the 
IFFT for signals Z 102 and X 104 is 8N*log2(2N). 

For the cross-correlation: 

The computational cost of computing the cross-correlation between signal 
Z 102 and signal X 104 in the spectral domain is 4N complex multiplications, or 
16N multiplications. 

For the auto-correlation: 

If signal Z 102 is a complex signal, computational cost of computing Zfotis 
4N. The computational cost of computing Zflt is 2N complex multiplications or 
8N. The computational cost of spectrally adding ZZfot and ZZfit to ZZot-N and ZZ^t- 
N is 8N additions. 
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Therefore, the total cost of maintaining the context of the auto-correlation 
of signal Z and the cross-correlation between X and Z is: 

Equation 24 

8N*log2(2N) + 4N + 8N + 8N + 16N 

5 

8N*log2(2N) + 36*N 

Consequently, the cost per sample is: 

8*log2(2N) + 36 

10 For a sample rate of SR samples per second, the number of computations 

required to maintain the context of the auto-correlation of signal Z and the cross- 
correlation between X and Z is: 



15 



8*SR*log2(2N) + 36*SR 

Since the IFFT is not included at every iteration but only when the filter 
coefficients are to be computed, these computations are not included here. 



The auto-correlation memory unit 302 and the cross-correlation memory unit 306 
20 are operatively coupled to the filter coefficient computation unit 202. 

The filter coefficient computation unit 

Figure 4 depicts the filter coefficient computation unit 202 in greater detail. The 
25 filter coefficient computation unit 202 includes a first input 440 for receiving the first set 
of data element fi"om the auto-correlation memory unit 302, a second input 442 for 
receiving the third set of data elements from the cross-correlation memory unit 306, a 
matrix generator unit 400 and associated memory unit 401, a linear solver unit 460 and an 
output 444 for releasing a set of filter coefficients 1 1 6. 
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The matrix generator unit 400 processes the first set of data elements received 
from the auto-correlation memory imit 302 to generate the second set of data elements 
indicative of the corresponding NxN auto-correlation matrix. For each entry in the NxN 
5 auto-correlation matrix, a mapping is defined from the first set of data elements in the 
auto-correlation memory unit 302 to the NxN auto-correlation matrix. 

In this specific example, the first set of data elements includes vector ZZ 
including a sub-set of N auto-correlation data elements indicative of the first row of the 
10 NxN auto-correlation matrix. If A is the NxN auto-correlation matrix, the first row of A 
is equal vector ZZ in memory unit 302 (figure 5). Because matrix A is symmetrical, the 
first column of A is also equal to vector ZZ in memory unit 302. The elements of the 
matrix can be derived as follows: 

15 Equation 25 

A[0]lj]=ZZ[j] forj = 0,,.N-\ 
A\i][0] = ZZ\j] fori^O.,,N-\ 
for z=l...A^-l 
for 7=L..Ar-l 

A\i][j]=ZZ[d]- SUBTRACT FACTOR + ADD FACTOR 
where 

d=\j-i\ 

mi n(i,y )-l 

SUBTRACT FACTOR = J^SAMPLE _SET Jl{kY SAMPLE _SET J\[k ^ d] 

minCiJ)-! 

ADD FACTOR = £ SAMPLE _ SET J^2[k] * SAMPLE _ SET J2[k + d] 

where i is the row index of the matrix, j is the column index of the matrix and d is the 
absolute value of the difference between the row and column index. The above described 
mapping allows expanding the vector ZZ, the fu*st sample set and the second sample set 
20 into a second set of data elements indicative of an NxN auto-correlation matrix A. 

In an alternative implementation, each row of the matrix A is generated on the 
basis of the previous row. In addition, since the matrix is symmetric, A[i][j] is equal to 
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Therefore it is possible to generate a triangular matrix instead of the entire 
matrix. Storing a triangular matrix also allows the costs in terms of memory use to be 
N*(N+l)/2 instead of N*N for the complete matrix. In this alternative embodiment, the 
elements of the matrix can be derived as follows: 

Equation 26 

40][/'] = ZZ[;-] /or; = 0...iV-l 
for / = l,..iV-l 
for j = L,.N-l 

Mb'] = Ai - W - 1] - SUBTRACT FACTOR + ADD FACTOR 
where 

SUBTRACT FACTOR = SAMPLE __ SET Jl[i - 1] * SAMPLE _ SET J\[j - 1] 
ADD FACTOR = SAMPLE _ SET J2[i - 1] * SAMPLE _ SET _#2[j - 1] 

Advantageously, this alternative implementation makes use of two multiply-and- 
add operations for each element of matrix A that is to be generated. As described above, 
since only a triangular matrix needs to be computed and stored (A is symmetric), there 
are N*(N-l)/2 elements of the matrix that are generated, for a computational cost of 
generating the matrix of N*(N-1). 

It will be readily apparent to the reader skilled in the art that the method described 
here can be applied to a first set of data elements, including any row or any column of the 
NxN auto-correlation matrix, by providing a suitable mapping. A graphical 
representation of an example of an auto-correlation matrix data structure A 700 is 
depicted in figure 7 of the drawings. The generated NxN auto-correlation matrix is 
stored in the matrix memory unit 401. The NxN auto-correlation matrix is a symmetric, 
positive definite matrix. 

The linear solver unit 460 processes the NxN auto-correlation matrix A in matrix 
memory unit 401 in combination with cross-correlation vector XZ from the cross- 
correlation memory unit 306 to solve the following linear system for a set of filter 
coefficients in vector h: 
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Equation 27 

where A is the NxN square symmetric matrix generated by the matrix generator 
5 unit 400, h is an IxM vector and XZ is an IxM vector. If M = N, a single vector "h" can 
be computed from the above equation. If M > N, then a vector "h" of dimension IxN can 
be computed for subsets of N elements of vector "XZ". There are many known methods 
that can be used to solve linear systems. Typically, the inverse of matrix A, namely A"\ 
needs to be computed in order to obtain h: 

10 Equation 28 

where 
A'A-'=I 

where I is an NxN identity matrix. 

15 Typically, computing the inverse of an NxN matrix is complex and requires 

significant computing resources especially when N is large. Several well known methods 
have been developed to reduce the complexity of this computation. Examples of such 
methods include QR substitution, Cholesky decomposition, LU decomposition, Gauss- 
Jordan elimination amongst others. Any suitable method for solving a set of linear 

20 equations may be used by the linear solver unit 460 to derive the vector h including the 
set of filter coefficients. For more information regarding methods for solving sets of 
linear equations, the reader is invited to refer to "Numerical Recipes in C: The Art of 
Scientific Computing", William H. Press et ah, Cambridge University Press (Chapter 2). 
The contents of this document are hereby incorporated by reference. 

25 

In a specific non-limiting example of implementation, the linear solver unit 460 
makes use of the symmetric and positive definite characteristic of matrix A by using 
Cholesky decomposition to solve the set of linear equations 8. Conceptually the linear 
solver unit 460 solves the following set of linear equations: 
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Equation 29 

Ah = XZ 



Cholesky decomposition generates a matrix W such that WW^™*^°^ = A. 
5 WW^'^"'P°'^ can be used to replace A in equation 29 as follows: 

Equation 30 

A new variable y = w^""'P°'ni is defined: 

Equation 31 

10 ^Transpose ^ _ ^ 

W^^'^P'^h is substituted for y in equation 30: 

Equation 32 

Wy^XZ 

is computed and used to solve for y: 

15 Equation 33 

solving for y 
y = W~^XZ 

^Transpose-i coHiputcd and the solution to equation 33 is used to solve for h: 

Equation 34 

solving for h 

20 

As shown in figure 4, the linear solver unit 460 includes a Cholesky 
decomposition unit 402, a triangular matrix inverter 404, a triangular matrix transpose 
inverter 405 and a matrix multiplier and solver 406. The Cholesky decomposition unit 
402 processes matrix A to generate a lower triangular matrix fTsuch that: 

25 Equation 35 
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Following this, the triangular matrix inverter 404 and the triangular matrix 
transpose inverter 405 process the lower triangular matrix W and its transpose 
respectively to generate the inverse of matrix W, namely W\ and the inverse of the 
transpose, namely w'^'^'^'''^'^ Although the linear solver unit 460 depicted in figure 4 
5 includes a triangular matrix inverter 404 and triangular matrix transpose inverter 405, 
these may be implemented by the same physical module without detracting from the 
spirit of the invention. In general, the inverse of lower triangular matrix requires fewer 
computations to compute than that of matrix A. 

10 The matrix multipher and solver unit 406 then solves the set of linear equations 8 

by substitution to obtain the set of filter coefficients in vector k The matrix multiplier 
and solver 406 receives W'^ and solves for a vector y: 

Equation 36 

solving for y 
y = W''XZ 

15 The matrix multiplier and solver 406 also receives w'^'^'^'''^"^ and use solution to 
equation 36 to solve for h as follows: 

Equation 37 

solving for h 

Vector h is then released at the output forming a signal including a set of N filter 
20 coefficients 116, It is to be appreciated that other methods and implementations for 
solving a set of linear equations using Cholesky decomposition are possible without 
detracting from the spirit of the invention. For example, although the implementation 
depicted in figure 4 makes use of triangular matrix inverter/ triangular matrix transpose 
inverter units 405 406, direct solving of the linear equations can be done as well. 

25 

A typical interaction 

A typical interaction will better illustrate the fimctioning of the filter adaptation 
unit 100. As shown in the flow diagram of figure 8, at step 800 the filter adaptation unit 
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100 receives a new sample of the first signal Z 102 and a new sample of the second signal 
X 104. At step 802, the context update module 200 updates the first set of data elements. 
This step 802 includes modifying the content of memory unit 302 (shown in figure 3) by: 
a) updating the sub-set of N auto-correlation data elements forming vector ZZ; b) 

5 updating the second sample set including the last N-1 received samples of the first signal 
Z; and if applicable, c) updating the first sample set including the first N-1 received 
samples of the first signal Z. Following this, at step 804, the context update module 200 
updates the third set of data elements. This step 804 includes modifying the content of 
memory unit 306 (shown in figure 3) by updating the set of cross-correlation data 

10 elements in vector XZ. Alternatively, a plurality of samples of signal Z 102 and signal X 
104 may be received at step 800 and accumulated in respective buffer units and steps 802 
and 804 can be effected on groups of the samples of the buffer units. As a variant, FFT 
techniques may be used on sets of N samples in the buffer units to update the sub-set of 
auto-correlation data elements forming vector ZZ and the set of cross-correlation data 

15 elements in vector XZ in order to reduce the number of computations required. 

At step 806 a test is effected to determine whether a scheduling command was 
received fi*om the scheduling controller. In the negative, the process returns to step 800 
where the filter adaptation unit 100 receives a new sample of the first signal Z 102 and a 
20 new sample of the second signal X 104. The loop including steps 800, 802, 804 and 806 
is repeated until a scheduling command is received fi:om the scheduling controller 204 
(shown in figure 2). Typically, several samples of the first and second signals are 
received by the filter adaptation unit 100 prior to a schedulmg command being issued. 

25 When a scheduling command is received, condition 806 is answered in the 

affirmative and the process proceeds to step 808. At step 808, if the sub-set of N auto- 
correlation data elements is stored on the spectral domain, an IFFT is first applied to 
obtain the sub-set of N auto-correlation data elements in the time domain. Similarly, if 
the set of M cross-correlation data elements is stored on the spectral domain, an IFFT is 

30 appUed to obtain the set of M auto-correlation data elements in the time domain. At step 
808, the sub-set of N auto-correlation data elements forming vector ZZ (in the time 
domain), the second sample set and the first sample set are expanded into tiie second set 
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of data elements to generate auto-correlation matrix A. Following this, at step 810, the 
linear solver unit 460 solves for h the linear set of equations A'h = XZ in order to obtain 
a new set of filter coefficients. The new set of filter coefficients 1 16 is then released at 
step 812. 

Advantageously, this method allows maintaining the context of the system by 
maintaining a subset of the first signal's auto-correlation data elements and the cross- 
correlation of the two signals X and Z. In a non-limiting example, using FFTs to update 
the auto-correlation data elements and the cross-correlation data elements, for a given 
filter length N, the computational cost can be as low as (4 * SR * log2N) + (SR * 18) 
(assuming signal Z 102 and signal X 104 are real input signals), where SR is the 
sampling rate for signals Z 102 and X 104. For example if N is 256 and the sampling rate 
SR is 8000 samples per second, the computational cost of maintaining the auto- 
correlation data elements and the cross-correlation data elements may be as low as 350 
kips (thousands of instructions per second) by using the methods described in this 
specification. If signals Z 102 and X 104 are complex input signals, the computational 
cost of maintaining the auto-correlation data elements and the cross-correlation data 
elements will be about double the cost as for real input signals, hi other words, the 
number of computations per new sample of signal Z and X to maintain the context of the 
system is proportional to log2N i.e. 0(log2N) where N is the length of the filter. 

The generation of a new set of filter coefficients 1 16 is delayed until a scheduling 
command is received. The computational costs of generating a new set of filter 
coefficients is: 

- 0(N^) to generate the matrix; 

- 0(NV6) for the Cholesky decomposition; and 

- 0(N^) for solving the linear equations. 

Advantageously, by providing a scheduling signal including a succession of 
scheduling commands and by selecting the intervals between the scheduling commands 
based on heuristic performance measurements, the computational costs of computing a 
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set of filter coefficient for each sample can be avoided without significantly deteriorating 
the apparent adaptation quality of the adaptive filter 1 10. 

The above-described process for producing a set of filter coefficients can be 
5 implemented on a general purpose digital computer of the type depicted in figure 9, 
including a processing unit 902 and a memory 904 connected by a communication bus. 
The memory includes data 908 and program instructions 906. The processing unit 902 is 
adapted to process the data 908 and the program instructions 906 in order to implement 
the functional blocks described in the specification and depicted in the drawings. The 
10 digital computer 900 may also comprise an I/O interface for receiving or sending data 
elements to extemal devices. For example, the I/O interface may be used for receiving 
the first signal Z 102 and the second signal X 104. 

Alternatively, the above-described process for producing a set of filter 
15 coefficients can be implemented on a dedicated hardware platform where 
electrical/optical components implement the functional blocks described in the 
specification and depicted in the drawings. Specific implementations may be realized 
using ICs, ASICs, DSPs, FPGA or other suitable hardware platform. It will be readily 
appreciated that the hardware platform is not a limiting component of the invention. 

20 

Although the present invention has been described in considerable detail with 
reference to certain preferred embodiments thereof, variations and refinements are 
possible without departing from the spirit of the invention. For example, forgetting 
factors in the auto-correlation and cross-correlation computations may be used to bias the 
25 results towards more recently received samples rather than weighing all samples of the 
signals equally irrespective of the time they were received. Therefore, the scope of the 
invention should be limited only by the appended claims and their equivalents. 



